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Thermodynamics is a macroscopic physical theory whose two very general laws are independent of 
any underlying dynamical laws and structures. Nevertheless, its generality enables us to understand 
a broad spectrum of phenomena in physics, information science and biology. Does thermodynamics 
then imply any results in quantum information theory? Taking accessible information in a system 
as an example, we show that thermodynamics implies a weaker bound on it than the quantum 
mechanical one (the Holevo bound) . In other words, if any post-quantum physics should allow more 
information storage it could still be under the umbrella of thermodynamics. 



Since "information is physical" the performance of information theoretic tasks are ultimately governed by the 
underlying physical laws used to process it. For example, in quantum mechanics, information that can be stored or 
accessed is limited by the Holevo bound On the other hand, information theory is also deeply connected with 
thermodynamics as most notably demonstrated by the resolution of the long-standing Maxwell's demon paradox 0,3 
on the basis of Landauer's erasure principle The insight acquired from Landauer's principle enabled the demon 
paradox to be extended to the quantum regime 0, Hj, 8] and its link with limits on efficiency of certain quantum 



information processing has also been established |Tol [llj . The amount of heat convertible into work in reversible 
and irreversible processes was considered in the context of quantum distinguishability |l2j and it was shown that 
distinguishing non-orthogonal states perfectly would lead to the violation of the second law of thermodynamics jl3j . 
The latter suggests that altering quantum laws may have dramatic consequences on our other theories. 

Here we derive a thermodynamical bound on accessible information in quantum mechanics from the second law of 
thermodynamics, which states in Kelvin's form "There is no thermodynamical cycle whose sole effect is the conversion 
of heat withdrawn from a reservoir into mechanical work." The background of our motivation is the fact that the 
generality of thermodynamical laws has led physicists to derive many, at first sight unrelated, results, such as general 
relativity Il4j . the superposition principle in quantum mechanics 15], and the wave nature of light [T^ to name a 
few. In this paper, we investigate what constraint the second law imposes on accessible information and show that 
thermodynamical bound is weaker than the Holevo bound. 

Assumptions we make here are, (a) Entropy: the von Neumann entropy is equivalent to the thermodynmaical 
entropy, (b) Statics and measurement: a physical state is described by a "density" matrix, and the state after a 
measurement is a new state that corresponds to the outcome ("projection postulate"), (c) Dynamics: there exist 
isentropic transformations. These rules can also describe probability distributions in classical phase space. Although 
we will use Dirac's ket notation for convenience, this does not mean that we use the full machinery of the Hilbert 
spaces (such as the notion of inner product) and we never use the Born trace rule for calculating probabilities. 

By accessible information we mean information obtained from an arbitrary measurement on a given system. To 
give a precise form of the Holevo bound let us consider two protagonists, Alice and Bob. Suppose Alice has a classical 
information source preparing symbols i = 1, ...,7i with probabilities pi, ...TPn- Bob attempts to determine the actual 
preparation i as best he can. Thus, after Alice prepared a state pi with probability pi and gives the state to Bob, who 
makes a general quantum measurement {Positive Operator Valued Measure or POVM) with elements Ej = Ei, Em, 
— 1' oil that state. On the basis of the measurement result he infers Alice's preparation i. The Holevo bound 
is an upper bound on accessible information, i.e. 

IiA:B)<Sip)-J2p^Sip^), (1) 

i 

where I{A : B) is the mutual information between the set of Alice's preparations i and Bob's measurement outcomes 
J, S{p) = — Tr(/3log2 p) is the von Neumann entropy and p — PiPi- The equality in expression Q is achieved if all 
Pi mutually commute, that is, [pi, pj] — for all i,j, and the measurement is performed in the joint eigenbasis of p/s. 
We will refer to this case as "classical" , as it corresponds to distinguishing between classical probability distributions. 

Let us now derive thermodynamical bound on the mutual information I {A : B). To this end we will consider a ther- 
modynamical loop that involves a conversion of heat into work, whose amount is equal to kThi2I{A : B) (throughout 
the paper we call fcTln2 unit of work as one bit. Here k is the Boltzmann constant and T is the temperature). 
Examining the condition on the work balance imposed by the second law, we will have a thermodynamical bound on 
I{A : B). 
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Consider a vessel of volume V filled with N molecules of dilute, inert, ideal gas. Suppose that piN molecules occupy 
the space on the left side (i) of the vessel, whose volume is PiV, and each individual molecule is in the quantum state 
Similarly, P2N molecules {pi + P2 — 1) are in the right side (i?) of volume P2V and are all in |V'2)- The two 
states, and \ip2), can be thought of as the states of an internal degree of freedom such as spin. The two types 
of molecules are initially separated by a partition and the pressures on both sides are equal. Note that this situation 
differs from the encoding/decoding scenario given above in which Bob has no access to spatial degree of freedom but 
can only measure internal degree of freedom of the molecules. Even though we primarily deal with only two pure 
quantum states and projective measurements with two possible outcomes, our consideration can easily be generalized 
to arbitrary numbers of general states and measurement outcomes. 

We can now have a thermodynamical loop formed by two different paths between the above initial thermodynamical 
state to the final state. In the final state, both constituents, and \ip2), will be distributed uniformly over the whole 
volume of the vessel. Hence, each molecule in the final state can be described hy p = J^iPili^i) ii^il' regardless of the 
position in the vessel. One of the paths converts heat into work, involving measurement (and thus it is irreversible, in 
general), while the other path, consisting of a quasi-static reversible process and isentropic transformations, requires 
some work consumption. 

The work-extracting process proceeds as follows. Suppose that we have two semipermeable membranes. Mi and 
M2, which separate two perfectly distinguishable (orthogonal) states |ei) and |e2)(= These membranes were 

considered by von Neumann TT] and Peres and shown to be physically legitimate. The membrane Mi acts as 
a completely opaque wall to molecules in |ei), but it is transparent to molecules in |e2). Similarly, M2 is opaque 
to molecules in |e2) and transparent to |ei). Thus, for example, a state is reflected by Mi to become |ei) 
with (conditional) probability p{ei\'4'i) and goes through with probability p{e2\'4'i), being projected onto [62). This 
corresponds to the quantum (projective) measurement on molecules in the basis {|ei), |e2)}, however, we do not 
compute these probabilities specifically as stated above. 

We replace the partition separating 1-01) and |'02) with the two membranes. Mi and M2. Keeping its temperature 
constant by contact with a heat bath of temperature T, each gas of molecules in |ei) or |e2) can expand isothermally 
until the pressures of each gas component at both sides of a membrane become equal. The amount of the mechanical 
work Wext, which can be withdrawn from the heat bath, is equal to the accessible information I (A : B), which is the 
amount of information Bob can obtain about Alice's preparation by measurement on p — '^iPi\'>Pi){ipi\ in the basis 
{61,62}. Figure n shows the equivalence between Wext and I{A : B). The same correspondence exists also if the 
initial state is a collection of mixed states, such as {pi,pi}, which means that Alice provides pi with probability pi. 
The transformation from the post-work-extraction state, which we call a hereafter, to the final state p can be done 
by a process shown in Fig. [5] and the minimum work needed is given by = S((j) — S{p). 

There is an alternative way to look at the process with semipermeable membranes. Maxwell's demon, who is 
sitting somewhere in (or by) the box, measures the state of each molecule in the basis {|ei), I62)} and memorizes all 
outcomes from the measurement on all molecules. Depending upon the actual outcome he operates a membrane Ali 
(i.e. "controls tiny doors" on Mi) so that only \ei) is reflected and the other state can go through. One may then ask 
whether or not some work needs to be consumed to erase the information recorded in his memory at a certain stage to 
close the thermodynamical cycle. We show that it is not necessary. Let jm) denote the demon's memory for outcome 
TO. After the observation and work-extraction by demon, the joint system of the principal system P and the memory 
M, cr^*^, can be described as a = PmpPm |m)(TO|, where Pp = \em){sm\ are projection operators. Hence, 
unlike the usual discussion of erasure principle with Szilard's engine [iSj, erasing demon's memory in this case is a 
logically reversible process due to a perfect correlation between P and M. Therefore a controUed-NOT-like global 
(isentropic) operation between P and M can reset the state of M to a standard initial state without consuming work. 
We can consider that isentropic transformations, in principle, involve no work transfer |l7j . The difference from the 
memory erasure in the Szilard model is that the degrees of freedom used for the work-extraction and measurement are, 
in our case, not the same. Here the external (spatial) and the internal (spin) ones are used, while only the external 
one is employed in the Szilard model. 

Another path, which is reversible, from the initial state to the flnal state is as follows. Let {|0i), |(/>2)} be an 
orthogonal basis which diagonalizes the density matrix p, such that p = X]iPj|V'i)(V'i| = where Xk 

are eigenvalues of p. Since any of {j-fAi), IV'2)} and {ji/)!), |02)} is a pure state, appropriate isentropic transformations 
can transform the initial state to a state in which XiV of the vessel on the left is occupied with \(j)i) and X2V on the 
right with \4>2)- By using new semipermeable membranes M[ and Mj, which distinguish and \4>2) perfectly, we 
obtain a state p uniformly distributed over the volume V, after gaining S{p) bits of work. As this transformation 
from {pi, \ipi)} to p via {A^, \(f>i)} can be carried out reversibly, the initial state can be restored from p by consuming 
S{p) bits of work. 

If the initial state is a combination of mixed states with corresponding weights as {pi, pi}, the extractable work to 
reach p — ^^PiPi becomes S{p) — '^^PiS^pi). This can be seen by considering a process {pi, pi} {PiP], 1'^-'])} 
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FIG. 1: Equivalence between the extractable work VKe^t and the accessible information /(A : B). Suppose that each l-^i) 
in the initial preparation was correlated with a state of another degree of freedom so that in the initial state (a) there are 
|'!/ji)|L) on the left of the vessel and \i\}-2)\R) on the right. As this auxiliary system is hypothetical, we cannot access to this 
degree of freedom throughout the process discussed in the main text. Nevertheless, if we could make use of membranes that 
distinguish |L) and then we can extract Hi^A) bits of work to reach the state (c), where H(yA) = H{pi) — — X^iP* log2Pi 
is the Shannon entropy. If we use the "proper" membranes, Afi and M2, that measure \ipi) in a basis {|ei)}, Wext bits of work 
will be extracted, and if \ipi) and \tp2) are not perfectly distinguishable the membranes will stop before reaching the end of 
vessel (as in (b)). Let us consider the gas in |ei), for example. In (b), the numbers of |ei)-molecules in the left and the right 
sides of Ml are p{'4'i)p{ei\'tpi)N = p{ei)p{ipi\ei)N and p(ei)p('!/>2fei)A'', respectively, where p{x) is the proportion of |a;) to A'' 
(thus p(i/'i) = Pi), and p{x\y) represents the probability of finding \x) in \y). By using the same membranes as those used in 
the direct path from (a) to (c) (namely, distinguishing \ei)\L) and |ei)|i?) that are separated by Afi), H{A\B) bits of work 
can be extracted in the process from (b) to (c). As these hypothetical work-extraction processes with the auxiliary system are 
quasi-static and reversible, a simple relation, H{A) = Wsxt + H{A\B), holds and this means Wext = I{A : B). 



{Afc, |0fc)} — > p, where {^* , |^}} and {A^, \<i>k)} are the sets of eigenvalues and eigenvectors of pi and p, respectively. 
The process (i) needs '^iPiS{pi) bits of work to be consumed, and similarly the process (iii) provides S{p) bits of 
work to us. As the process (ii) involves only isentropic transformations, nothing needs to be written in the work 
account book. As a result, S{p) — J2iPi'^iPi) bits of work will be extracted. 

Now we can discuss what the second law requires for the thermodynamical loop, which proceeds as {pi, Pi} — > cr — > 
P ^ {PiT Pi} (See Fig. The second law states that the net work extractable from a heat bath cannot be positive 
after completing a cycle, i.e. Wext — Winv < 0. For the cycle described above, it can be expressed as 

I{A : B) < S{p) - J2 P^S{p^) + A5, (2) 

i 

where AS* — S{a) — S{p). Note that a is identical to the resulting state of a projective measurement onj) in the 
basis {|ei), |e2)}. Thus, a = ^jPjpPj with Pj = \ej){ej\ and consequently AS" is always non-negative jl/^. The 
inequality |(2J) holds even if the measurement by membranes was a generalized (POVM) measurement. This is because 
any POVM measurement on a principal system P can be realized by introducing an auxiliary system (environment) 
E and performing a projective measurement on E after letting P and E interact with each other under an appropriate 
global unitary (thus isentropic) evolution Q. Even in this case, AS" can be easily shown to be non- negative by using 
the fact that appending a pure state to the principal system does not change the entropy. 

The form of Eq. ((SJ is identical with that of Eq. for the Holevo bound, except for an extra non-negative term, AS*. 
The existence of AS* is essential in the cycle, where I{A : B) bits of work is extracted, since the returning path (from 
(b) to (c) in Fig. |3Jl is reversible, thus optimal. This illustrates that there is a difference between the bound imposed 
by quantum mechanics (the Holevo bound) and the one imposed by the second law of thermodynamics. Namely, 
there is a region in which we could violate quantum mechanics while complying with the thermodynamical law. In 
the classical limit, the measurement is performed in the joint eigenbasis of mutually commuting p^'s, consequently 
AS* — 0, and in addition the Holevo bound is saturated: I{A : B) — S{p) — J^iPi^iPi)- Thus, the classical limit and 
the thermodynamical treatment give the same bound. 

The same saturation occurs when an appropriate collective measurement is performed on sequences of m molecules, 
each of which is taken from an ensemble {pi,Pi}. When m tends to infinity 2™('^''')~^> ^'''^'^'''^^ typical sequences (the 
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FIG. 2: The thermodynamical process to transform a into p. Firstly, after attaching an empty vessel of the same volume to that 
containing the gas a, the membranes Mj are used to separate two orthogonal states |ei) and |e2) ((a) to (c)). As the distance 
between the movable opaque wall and the membrane M2 is kept constant, this process entails no work consumption/extraction. 
As a = Cj\ej){ej\, compressing each |ej)-gas into the volume of CjV as in (d) makes the pressures of gases equal and this 
compression requires S{a) = — '^Cj logj Cj bits of work. Secondly, quantum states of gases are isentropically transformed, 
thus without consuming work, so that the resulting state (e) will have AjA'^ molecules in \<j>j), where p ~ ^j\4'i){4'j\ is the 
eigendecomposition of p. To reach (f), S{p) bits of work can be extracted by using membranes that distinguish As a 

result, the work needed for the transformation cr ^ p is S{a) — S{p) bits. 
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FIG. 3: The thermodynamical cycle to discuss the second law. The cycle proceeds from the initial state (a) to the final state p 
(c) via the post- work-extraction state a (b), and returns to the initial state with a reversible process. The existence of a heat 
reservoir at temperature T is assumed for isothermal expansion/compression processes. 



sequences in which pi appears about piin times) become mutually orthogonal and can be distinguished by "square- 
root" or "pretty good" measurements This situation is thus essentially classical, hence, AS* — > and the Holevo 
bound will be saturated. 

An interesting implication of our result is the relationship between the second law and the erasure principle. It has 
been shown that the form of the Holevo bound can be obtained from the erasure principle |lOj |. Together with this, 
our result suggests that the erasure principle and the second law, which are commonly believed to be equivalent, do 
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not necessarily give the same result in the quantum regime. 

As mentioned earlier in this paper, Lande has claimed that the superposition principle in quantum mechanics can 
be derived by purely thermodynamical arguments that are similar to our consideration If this conclusion was 
correct even in its spirit and if we could really derive quantum mechanics from thermodynamics, then we should also 
be able to confirm the Holevo bound exactly. But, as shown here this is not the case. This should, however, not 
necessarily be perceived as a failure of thermodynamics. It is not unlikely that quantum theory will be superseded by 
a higher level generalization of which it is a special case, just like classical mechanics is a limiting case of quantum 
mechanics. Our paper shows that even if the amount of stored information in the post-quantum theory can be greater 
than allowed quantum mechanically, this can happen without violating the second law. 
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